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1. 


Introduction 


Panel  studies  are  statistical  studies  in  which  two  or  more  variables  are 
observed  for  two  or  more  subjects  at  two  or  more  waves  or  points  in 
time.  In  most  panel  studies  the  number  of  variables  and  the  number  of 
waves  is  small  but  the  number  of  observations  at  any  given  wave  is 
large.  In  this  paper  we  focus  on  the  model  which  has  multiple 
responses,  multiple  predictors  and  an  error  structure  that  Includes  an 
individual  specific  random  component.  We  consider  the  problem  of 
computing  the  maximum  likelihood  estimates  of  the  regression 
coefficients  and  covariance  terms  for  this  model  and  consider 
alternative  estimators.  We  apply  our  results  to  a  set  of  data  on  the 
relationship  between  the  perceptions  and  attitudes  of  patients  enrolled 
in  a  health  maintenance  organization. 

The  model  we  consider  is  closely  related  to  panel  models  that  have  been 
studied  widely  in  applied  statistics  and  social  methodology.  Foremost 
it  is  a  multivariate  version  of  the  "components  of  variance"  model  found 
in  the  statistics  and  econometrics  literature  [e.g.,  Balestra  and 
Nerlove  (1966),  Chamberlain  (1984),  Hausman  and  Taylor  (1981)]. 
Recently,  excellent  reviews  of  this  work  have  become  available  [Dlelman 
(1983),  Hsiao  (1985,  1986)]. 

Second,  the  model  is  both  an  extension  and  simplification  of  the  most 
natural  covariance  structure  formulation  of  the  panel  model,  the  model 
with  independent  errors  over  time  [eg.,  Joreskog  and  Sorbom  (1984), 
Joreskog  and  Goldberger  (1975)].  It  is  an  extension  in  that  it  allows 
errors  to  be  correlated  over  time  but  a  simplification  in  that  it 
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assumes  measurements  are  made  without  error  and  thus  does  not  Include  a 
measurement  model. 

Finally,  the  model  can  be  viewed  as  an  alternative  to  the  multivariate 
panel  model  with  an  autoregressive  error  structure  over  waves  [e.g., 
Mayer  (1986),  Mayer  and  Carroll  (1986)].  The  autoregressive-error  model 
assumes  that  individuals  have  a  common  error  structure  over  time  and 
that  for  a  single  individual  the  correlation  between  the  errors  at  two 
waves  is  a  geometrically  decreasing  function  of  the  time  separating  the 
waves.  The  individual  effect  model  we  consider  assumes  that  the 
temporal  structure  of  the  errors  differs  across  individuals  but  that  for 
a  single  individual  the  correlation  between  the  errors  at  two  waves  does 
not  depend  on  the  time  between  the  waves. 

The  results  we  offer  are  heavily  dependent  on  the  results  of  T.  W. 
Anderson  (1969,  1970,  1973,  1984)  on  estimating  covariance  matrices  with 
a  known  structure  and  his  results  on  vector-valued  autoregressive  models 
[Anderson  (1978)],  on  the  comprehensive  study  of  T.  Szatrowski  (1980)  of 
necessary  and  sufficient  conditions  for  a  linear  model  to  yield  closed 
form  maximum  likelihood  estimators,  and,  finally,  on  the  work  of  Magnus 
(1982)  on  maximum  likelihood  estimation  in  a  multivariate  panel  model 
somewhat  similar  to  the  model  we  examine.  Our  interest  in  using  this 
model  to  analyze  social  science  data  was  inspired,  in  part,  by  the  work 
of  Anderson  and  Hsiao  (1981,  1982)  on  maximum  likelihood  estimation  in  a 
univariate  version  of  this  model  which  includes  lagged  endogenous 
predictors,  although,  in  this  paper  we  do  not  tackle  the  problem  of 
lagged  endogenous  predictors. 
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We  close  the  introduction  by  noting  that  since  the  individual  effect 
panel  model  can  be  cast  as  a  covariance  structure  model,  values  of  the 
maximum  likelihood  estimates  are  readily  obtained  by  applying  a  standard 
covariance  structure  estimation  program  (provided  it  is  capable  of 
handling  somewhat  complicated  constraints  on  the  covariance  matrix). 
Thus  the  model  can  be  estimated  using  procedures  that  have  become  fairly 
standard  in  social  science  research;  in  fact,  we  use  such  a  program 
(LISREL)  to  obtain  estimates.  Our  role  as  statistlcans  serving  social 
scientists  is  to  study  the  behavior  of  the  statistical  procedures, 
including  estimators,  being  used  in  empirical  social  research.  In  the 
spirit  of  this  service  we  offer  our  results. 

In  the  next  section  we  formulate  the  model  and  dispense  with  our 
preliminaries;  in  the  third,  we  present  our  results  on  estimation  for 
our  model,  and  in  the  fourth  we  present  a  numerical  example  of  our 
calculations.  The  last  section  contains  brief  comments  on  our  results 
and  current  research  directions. 


II.  Preliminaries 


Let  be  a  p  dimensional  response  vector  for  n  independent  subjects  at 
T  waves.  The  structure  of  the  response  is 


!it  ■  !  “it  +  !it  ‘  '  * . "  !  '  -  ' . 


(2.1) 


where  w^^  is  a  k  dimensional  exogenous  vector,  B  is  a  p  x  k  matrix  of 
regression  coefficients,  and  e^^  is  a  p  dimensional  unobserved  error 


vector,  uncorrelated  with  and  with  structure 

e.^  =  a.  +  U....  1  =  l,...,n  ;  t  =  1,...,T 

_it  _i  ...it 


(2.2) 
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where  a.  and  u.  are  independent  normal  (Gaussian)  errors,  with  common 
~it 

mean  0  and  common  nonsingular  covariance  matrices  A  and  ^  , 

respectively.  Provided  i  j  or  t  s  oi^  and  ot^  are  independent  as 

are  u.^  and  u.  . 

-it  ~js 


We  re-express,  in  vector  form,  the  model  by  letting 

t  f 

^i "  '-ii’-'-’^iT^’  :i  ■  ^riii’  ••  ' 

then  the  equation  in  (2.1)  becomes 


,  w^^)  and  e^  =  (e^^,  . 


!iT^ 


z.  =  (I  H  B)  w.  +  e  (2.3) 

-1  -  -1  -1 

If  we  let  be  the  covariance  matrix  of  e.  then 
-  -1 

=  I  H  ^  +  11*  H  A  (2.4) 

where  h  indicates  the  Kronecker  product.  The  diagonal  blocks  of  SI  are 
identically  ^  +  A  and  the  off-diagonal  blocks  are  identically  A. 


In  anticipation  of  developing  results  similar  to  those  of  Anderson 
(1973)  we  reexpress  the  model  as 

z.=X.b+e.  (2.5) 

-1  -1  -  -1 


where  X.  is  a  known  matrix  and  b  is  a  unknown  vector. 

-1 

To  effect  this  reexpression  we  write  B  and  S2  in  the  form 
r  m 


B  ^  K  K 

-  .  n  ~n 

n=l 


SI  =  Z  o  G 

g=0  ^ 


where  the  H,  's  and  G  's  are  known  matrices,  the  3,  's  and  o  's  are 
~h  -g  h  g 


unknown  scalars,  r  is  the  number  of  distinct  elements  in  B  and  m  +  1 
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is  the  number  of  distinct  elements  in  Continuing,  let  = 

vec  (H,  W.)  where  W.  =  (w.,,  ...»  w.„);  let  X.  =  (x, . ,  x 

^h„i  „il  _iT  ’  „li  ^ri 

and  let  b  =  (3j^>  •••»  •  Using  and  b  as  just  defined,  the 

expression  in  (2.5)  is  obtained  by  applying  the  following  result  of 
Neudecker  (1969): 


Lemma  1 :  For  any  conformal  matrices  X,  Y  and  Z 
vec  (XYZ)  =  (z'h  X)  vec  (Y) 


where  If  A  Is  a  n  x  p  matrix  with  1th  row  a^  then  vec  (A)  is  the 

I  I  I 

vector  (a, , . . . ,a  )  . 

~  i  ~n 


III.  Maximum  Likelihood  Estimation 


Our  results  begin  by  applying  the  scoring  method  of  Anderson  (1973) 
to  obtain  Implicit  equations  for  the  maximum  likelihood  estimates. 
We  offer 


Proposition  1:  The  maximum  likelihood  estimates  of  B,  and  A  are 
the  solutions  of  the  equations 


m 

tr  (Z 
h=0 


%  ?h^ 


-1 


G 

~g 


m 

=  tr(E  a 
h=0 


h  ?h^ 


-1 


G 

-g 


m 

(Z  a 

h=0 


h 


-1 


C 


(3.1) 


n 

C  =  1  Z  [z.  -  vec  (BW.)][z.  -  vec 
n  1=1 


(BWi)i 


where 
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t)  r  ,  _  ”  »  _i 

E  E  X,  X..3.  =  E  X,  ,0  z. 

,  ,  .  ,  ~ni»  „ii  1  .  ,  ~hi- 

1=1  j=l  1=1 


(3.2) 


The  proof  of  Proposition  1  begins  with  the  likelihood  function  of  all 
Tnk  observations  which  can  be  espressed  as 


L(B,  fi)  =  (2ir)  exp{-J^  I  [z.  -  (I  a  B)  w,]'fi"^ 

~  ~  ~  2  i=l  ~  ~  ~ 


[z^  -  (I  B  B)w^] } 


Let  i  =  (2/n)log  L  =  c^^  -  log  jjl|  -  tr  (2  ^  C 


(3.3) 


where  Cj^  is  the  constant  -kT  log(2'n')  and 


C  =  n  E  [z,  -  (I  B  B)w,][z.  -  (I  B  B)w,]' 
•“  i=l  ^  ** 


(3.4) 


Define  the  matrix  Y.  =  (z ,z ._) .  Since  (I  b  B)  w.  =  vec  (BW.)  and 

~1  .,11  ~il  ~  ~  ~i  --1 

z,  =  vec  (Y.),  C  can  be  expressed  as 

~i  ,.1 


C  =  n  "  E  [z.  -  y.][z.  -  y.]’ 
,  ,  ~i  ~i  ~i  ~i 

1=1 


(3.5) 


where  =  vec  (BW^) . 

Applying  to  the  following  formulae  of  Anderson  (1973) 


(3fi/30  )  =  G 

g  ~g 


(3fi  ^/30  )  =  G  fi  ^ 

g  ~  -g- 
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8  log  I  £2 


=  tr  £2  ^  G 


8a 


-8 


yields 


=  -tr  £2"^  G  +  tr(£2"^  G  £2"Sc 
8a  ~  ~g  ~  -g  .  ~ 

5 


(3.6) 


substituting  vec  (S  6  H  W.)  for  y.  in  equation  (3.5)  and  dlfferen- 
h=l 

tlatlng  equation  (3.3)  with  respect  to  6^  yields 


-1 

8&  =  -2  ^  [-vec  (H,  W.)]'£2  [vec(Y.)  -  vec(BW.)] 

t\Q  ,  -  ^  X 

op,  tl  1*1 
n 


(3.7) 


Setting  the  derivatives  equal  to  zero  yields  the  estimating  equations 


tr  £2  "^G  =  tr  £2“^G  f2"^C 


~8 


~8 


(3.8) 


-1 

S  [vec  (H,  W.)]'£2  [vec  (BW.)]  = 
.  ,  ~n  ..1  ~ 

1=1 


S  [vec  (H^W.)]'f2  ^  [vec  (Y.)] 
1=1 


(3.9) 


m 

since  £2  =  Z  0  G  equation  (3.8)  can  be  expressed  as  equation  (3.1) 
~  h=0 

r 

Since  vec  (BW.)  =  Z  vec(H.W.)  8.  equation  (3.9)  can  be  expressed  as 
j=i  J 


-1 

Z  Z  [vec(H,W.)]'  £2  [vec(H  .W. )  B .  ]  = 

.  ,  .  ,  _n.,i  ~J~i  1 

1=1  3  =  1 
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S  [vec(H,W.)]’  [vec(Y.)] 


Since  X,  .  =  vec  equation  (3.10)  becomes 

..hi  ..h..! 


n  r 
I  I 
1=1  j=l 


X,  .  0 
..hi  .. 


-1 


Xu  • 
..hi 


J 


n 

=  I 
1=1 


X,  .  fi  ^ 
..hi  .. 


z . 
..1 


which  Is  equation  (3.2)  and  the  result  Is  complete. 


(3.10) 


Following  the  suggestion  of  Anderson  (1973)  the  estimating  equations 

[(3.1)  and  (3.2)]  can  be  used  to  Iterate  Initial  estimates  of  B,  A, 

and  ^  .  Begin  by  setting  the  covariance  matrix  to  the  Identity 

matrix  and  solving  equation  (3.2)  for  Initial  estimates  ...» 

of  3,»...»3  .  These  estimates  are  used  to  give  an  Initial  estimate 
1  r 

B^*^^  =  Z  3^*^^  H,  of  B.  A  pT  X  pT  matrix  is  then  computed  by 

j=l  J  ~ 

substituting  B^^^  for  B  in  equation  (3. A).  The  matrix  Is 

substituted  for  C  in  the  expression 
m 


I 

f=0 


tr  0  G  0  Gj.  a, 
~  .g  .  .f  f 


tr  0  G  0  C 
~  -g  - 


(3.11) 


where  0  is  a  fixed  matrix.  The  equation  In  (3.11)  Is  solved  for 

"(0) 

Initial  estimates  which  are  used  to  give  an  initial  estimate 

of  the  covariance  matrix  n. 


.(0) 


m 
=  I 
f=0 


°f  2f 


The  procedure  continues  by  substituting  for  £2  in  (3.2)  and  solving 
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for  new  estimates  thus  for  a  new  estimate  of  B. 

This  new  estimate  is  used  in  the  equation  in  (3.5)  to  yield  which 

^(1)  (1) 

is  used  for  C  in  equation  (3.1),  and  o'  is  computed.  Then  = 

^  r  ^ 


(1), 


m  .. 

E  is  obtained.  Continuing  until  convergence  yields  the 

f=0  ^ 


maximum  likelihhod  estimates.  The  matrix  0  in  (3.11)  may  be  chosen 
to  simplify  calculations.  We  use  0=1. 


Standard  multivariate  statistical  theory  yields  that  the  maximum 
likelihood  estimator  B  is  asymptotically  efficient  and  asymptotically 
normal  with  covariance  matrix  that  has 

[1/2  tr  ]"^  (3.12) 

~  -h-  ~g 

as  its  (h,g)th  entry.  If  only  one  iteration  is  used  we  call  the 
resultant  estimator  the  Anderson  "one-step  estimator."  The  usefulness 
of  the  one-step  estimators  arises  from  a  result  of  Anderson  (1973)  which 
guarantees  that  they  enjoy  the  asymptotic  properties  given  above  for  the 
maximum  likelihood  estimator. 

In  practice,  these  equations  [(3.1)  and  (3.2)]  are  most  useful  if  the 
sample  size  (n)  is  large;  since  then,  a  single  iteration  gives 
satisfactory  results.  They  are  not  as  useful  for  obtaining  the  maximum 
likelihood  estimates  since  each  Iteration  requires  solving  a  complex  set 
of  equations.  Besides,  convergence  of  this  iterative  procedure  is  not 
guaranteed  [Szatrowski  (1980)]. 


A  second  set  of  estimating  equations  is  obtained  by  applying  the 
following  results  of  Magnus  (1982). 
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Lemma  2 :  Let  D  be  a  diagonal  T  x  T  matrix  with  positive  diagonal 
elements  and  let  A  and  B  be  square  matrices  of  order  k.  The  kT  x  kT 
matrix 

1 

fi  =  Dl  IDhA  +  DhB 

has  determinant  |fi|  =  |d|  |c|  |b|  and  if  is  non-singular 

it  has  Inverse 

=  -  1  1'  H  (C“^  -  b”^)  +  d“^  h  b”^ 

-  a  ^  ^ 

where  C  =  B  +  aA  and  a  =  tr  D 

Lemma  3 ;  For  conformal  matrices  A,  B,  C,  D 

tr  D  B’A’C  =  vec  (A')  (B  a  C)  vec  (D) 

Lemma  4;  For  conformal  matrices  A,  B 
tr  A’  B  =  (vec  A)'  (vec  B) 

Applying  these  results  yields 

Proposition  2:  The  maximum  likelihood  estimates  of  B,  and  A 
satisfy 

(3.13) 

BW^)'  (3.14) 

-  M)W^'  =  0 


(i  +  A)  =  1  E  (Y.  -  BW.)  M(Y.  -  BW.)’ 
Z  ~  1  .,.,1 

n  1=1 

-1  ” 

[n(T-l)]  E  (Y^  -  BW^)(I-M)(Y.  - 
i=l  ~  ~  ~  ~  ~ 

n  .  t  n  _1 

E  (Y.  -  BW.)W.  +  E  TA|  (Y.  -  BW  )(I 


(3.15) 
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where  M  is  the  T  x  T  matrix  T  ^  1  1' 

The  proof  of  Proposition  2  begins  by  noting  that  the  Tk  x 
matrix  ^  can  be  expressed  as 

where  1  is  a  T  dimensional  vector  of  ones  and  is  the  T 
matrix.  Applying  Lemma  2  yields 

\a\  =  It  +  ta  I 

and 

=  t"’-  1  1'  h  (t  +  TA)“^  +  (I  -  t"^  1  1’)  h 


The  log  of  the  likelihood  function  can  be  expressed 

=  c  —  n  log  I I  —  ^  ^  e.  ^  ^  e. 

2  '  2  1=1  ^ 

where  c*  =  -  kT  log  (2Tr) 

Using  the  expression  for  ^  displayed  in  (3.16)  and  the 

e.  =z.  -  (IsB)w. 
yields 

e.  ^2  ^  e.  =  {[z.  -  (I  H  B)  w.]'[M  h  (t  h  TA) 

~i  ~  ~  ~  ~i  ~  ~ 

[z^  -  (I  H  B)  w^]  }  +  -  (I  H  B)  w^]'[(I  -  M)  H  t 


[z^  -  (I  H  B)  w^] } 


Tk  covariance 


X  T  Identity 


(3.16) 


(3.17) 


fact  that 


(3.18) 
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Since  w.  =  vec  (W.)  and  z.  =  vec  (Y.) 

-1  ~i  ~i 


e! 


e . 

-1 


{[vec  -  vec  (BW^) ] ' [M  h 


(i+  TA)"^] 


[vec(Y^)  -  vec  (BW^)]}  +  {[vec(Y^)  -  vec(BW^)]' 


[(I  -  M)  H  ^  ^][vec(Y^)  -  vec  (BW^)]} 


(3.19) 


Plugging  (3.19)  into  (3.17)  and  applying  Lemmas  2  and  3  yields 


Jl  =  c*  -  n  log  (It  +  TA|  ItT"^)  -  1  tr[  ^  (Y.  -  BW.) 

2  ~  ~  ~  2  1=1 

M(Y,  -  BW,)'(t  +  TA)~^]  -  j_  tr  [  2  (Y.  -  BX.) 

~i  ~  .  2  1=1 

(I  -  M)(Y^  -  BW^)'t“^] 


Total  differentiation  yields 


d£  =  -  n  tr  (t  +  TA)”^  d(t  +  TA)  -  n  (T-1)  tr  dt 

2  ~  ~  ~  ~  2  ~  ~ 

"  ^  -1 

+  tr  2  ($  +  TA)  \y.  -  BW.)M  W.  d  B'  + 

1=1  ~  ~  --1  -  ~i 

n 

+  J.  tr[  I  (t  +  TA)  \y.  -  BW.)M(Y.  -  BW.)'(t  +  TA) 
2  i=l  ~  ~  ~ 

"  -1  ' 

(dt  +  TdA)]  +  tr  Z  t  (Y  -  BW. ) (I-M)W .dB' 

i=l  ~  - ^  ~ 


n 


+  tr  Z  t  ^(Y.  -  BW,)(I  -  M)(Y.  -  BW.)'t 

2  1=1  ~  -  -  ~i  ~~i  ~ 


-1 


d  t 
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which  can  be  written  as 


dJl  =  -  ^  nT  tr  A  d  A  +  n  tr  I  d  ^  +  tr  B  d  B' 
2  -~2~“  ~~ 


(3.20) 


where 


A  =  (i  +  TA)“^  +1  2  (i  +  TA)  ^(Y.  -  BW.)M(Y. 

„  „  „  —  .  ,  -  -  _ 1  ~  ~i 

n  1=1 


-1 


BW^) ' +  TA) 


-1 


—1  —1  —1 
^  =  (^  +  TA)  -  (T  -  1)^  -  J.  E  [(^  +  TA)  (Y.  -  BW.)M 

n  i=l  “  ~  ~ 


—  1  —1 

(Y.  -  BW.)  ’  (^  +  TA)  ]  +  E  t  (Y.  -  BW.)  (I  -  M) 
~  ~~  ~  ~  n  i=l  ~  “  ~  ~ 


(3.21) 


.+-1 


and 


(Yi  -  BW^)'^ 


B  =  E  (|  +  TA)"'’(Y.  -  BW.)  MW.'  +  E  (Y.  -  BW.)(T  -  M)w’ 

~  i=l  ~  ~  i=l  ~ 


h-1 


Applying  Lemma  4  transforms  equation  (3.20)  to 


dJl  =  (nT/2)  [vec(dA)]'  vecA  +  n  [vec(d^)]'  vec(^) 

2  ~  ~ 


+  [vec  (d  B '  ) ]  '  vec  B 


Since  dA,  d^  and  dB  are  non-zero  dJl  =  0  Implies  A,  ^  and  B  are  0 
which,  using  the  equations  displayed  in  (3.21),  yields  the  three 
equations  (3.13)  (3.14)  and  (3.15). 
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The  two  sets  of  equations  we  have  derived  for  the  maximum  likelihood 
estimates  would  be  of  limited  value  if  closed  form  expressions  existed 
for  the  maximum  likelihood  estimators.  For  completeness,  we  show  that 
such  is  not  the  case  -  there  exists  no  closed  form  expression  for  the 
maximum  likelihood  estimates.  We  apply  the  following  result  of 
Szatrowski 
(1980) 

Lemma  5 :  For  the  multivariate  linear  model  with  parameter  vector  B, 
error  covariance  matrix  JJ,  and  design  matrix  X  there  is  an  explicit 

solution  for  the  maximum  likelihood  estimator  B  of  B  if  any  only  if 

(x!  X.)  x!  =  (x!  X.)"^  X, 

We  have  for  our  model 

Proposition  3;  Explicit  solutions  do  not  exist,  in  general,  for  the 
maximum  likelihood  estimates  of  B  but  do  exist  if  A  =  0  in  which 
case  the  model  reduces  to  the  independent  error  model. 

The  proof  begins  by  applying  Lemma  2  to  the  covariance  matrix 
shown  in  display  (2.4);  we  have 

=  M  H  (^  +  TA)  (I  -  M)  H 
where  M  =  T  ^  1  1 ' . 
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A.  = 


'(1) 

x^2) 

x^^~ 

il 

^  •  i  •  • 

ll 

•  ^il 

• 

• 

• 

• 

• 

• 

• 

• 

• 

(1) 

(k) 

i,T 

^i.T  •  • 

•  ^i.Tj 

where  x.  =  (x^^\.., 

~it  It  It 


For  example,  if  k=2,  then  the  parameter  matrix  B  =  B 


11 

^12 

21 

^22 

and  X,  =  A.  H  I 


(1) 

(2) 

^1 

^il 

where  A,  = 

• 

• 

• 

• 

• 

• 

^(2) 

i,T 

Simple  calculation 

shows 

1 

X.  =  A.' 

H  I 

x.s^ 

H  I)  [M  : 

=  (A^'M) 

H  (^  +  ' 

-1 


-1 


k-1. 


^-1 


consequently 

=  (A.'MA.)  H  (^  +  TA)"^  +  A,'  (I  -  M)A.  h 

'  -1  -1 
(X^X^)  X^  =  (A^'A^  H  I)  (A^’  H  I) 

=  (A.'A.)"^  A.  H  I 


(3.22) 
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and  thus 

'  -1  '  -1 
(X.S^  X,)(X.X.)  X. 

+  A. '(I  -  M)A.  (A. ’A.)"^a!  h  t”’-  (3.23) 

Suppose  the  expressions  in  (3.22)  and  (3.23)  are  equivalent.  Since 
(|  +  TA)  and  ^  are  positive  definite  either  a)  A  =  0  or 
b)  A^(A^’A^)  =1.  If  A  =  0  the  model  becomes  the  independent 

errors  model  studied  by  Mayer  (1985)  and  Anderson  (1978)  which  does 

-1 

allow  an  explicit  solution  for  B.  If  for  every  i,  A^(A^'A^)  A^'  =  I 

t  I 

then  X,b,  =X.(X,X.)  X,z,  =  z.  and  the  model  is  degenerate.  Since 

-..I.*.!  -N.1 

neither  condition  holds  in  general,  applying  Lemma  5  yields  that 
there  is  no  explicit  maximum  likelihood  estimator. 

Having  shown  that  no  closed  form  expression  exists,  in  general,  for  the 
maximum  likelihood  estimators,  we  display  a  modified,  somewhat 
simplified,  model  for  which  the  maximum  likelihood  estimators  yield 
closed-form  expression.  This  result  extends  a  result  of  Anderson 
and  Hsiao  (1981)  to  the  multivariate  panel  model. 

Proposition  4:  Explicit  maximum  likelihood  estimators  of  B  do 
exist  for  the  model  displayed  in  (2.1)  and  (2.2)  provided  there 
exists  an  additional  wave  0  for  which  z.„  has  structure 

~i0 

z.rt  =  B  w.„  +  a.  i  =  l,...,n 


=  A.'MA.(A.'A.)"^A.'  H  (i  +  TA) 

.S.1  ^ 


-1 
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This  model  assumes  that  the  only  error  for  the  Initial  observation  is 
the  random  individual  effect  a.. 


For  this  model  equations  (2.1)  and  (2.2)  can  be  combined  into 


z.  =  Bw.  +  (z.^  -  Bw.-)  +u, 
^it  ....it  \i0  ....iO  ..it 


The  likelihood  function  can  be  expressed  as 


L(B,  A,  ^)  = 


exp  (-  1)  {£  tr  r‘  E  -  510  '  !  '  ”io” 

2  t=l  1=1 


!io  -  ?<rit  - 


rio»' 


+  tr  A 


-1 


n 

S 

1=1 


If  we  let  i  =  2  log  L  then 
n 

T  n 

£  =  c  -  log  Ia]  -  T  log  I^I  -  J.  {  I  tr  f  E 

■'  n  t  =  l  i=l 


'ht  -  !io  -  -  !io  -  !<rit  -  rio”'  * 


-1  ' 
tr  A  E  z._z.„ 

.  T  .l0_l0 
1=1 


(3.24) 


where  Cj^  =  -  k  (T  +  1)  log  (2ir) 


To  maximize  the  expression  in  (3.24)  we  take  derivatives  and  set  them 
equal  to  zero  yielding 
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-1  " 

=  2  Z  ^  Z  [z  (w  -  w._)'  -  z.^  (w  -  w.„)' 

—  ,  I  .  ,  ^«,it  ~it  ~iO  >iO  ~it  „iO 

oB  n  t=l  1=1 


-  ?'rit  -  ?io''rit  -  ■  ? 


which  yields  the  maximum  likelihood  estimator 


B  -  {(„T)-1  I  :  (w,^  -  »J„)'  -  z’q) 

t=l  1=1 


{(OT)-^  E  :  (W.J.  -  WjpXwj,  -  Yio'T* 

t=l  1=1 


For  the  maximum  likelihood  estimator  of  the  covariance  matrices  we 
have 

-1  -1  -1  -1  ' 

85,  =  -  A  -  n  [-  A  A’  Z  z.-  z.„]  =  0 

H  -  -  -  1-1 

which  yields  the  maximum  likelihood  estimator 


■  i  liO  510 

n  1=1 


and,  finally  we  have 

|4  ■  -  T  r'  -  t/,  <  -  r'  fh.J  i-t  -  !io  -  !<”it  -  »i0>’ 

8^  t=l  1=1 


'!it  -  !io  -  5'Yit  -  ■  ? 
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which  yields  the  maximum  likelihood  estimator 


I  =  (nT)-^  {  Z  Z  (z.^  -  z^Q  -  B(w.^  -  w.^) ] 
t=l  1=1 


T  n 


'fit  -  fio  -  ?<fit  -  rio’’* 


which  completes  the  proof. 


Returning  to  the  more  general  model,  we  consider  a  strategy  for 
computing  the  maximum  likelihood  estimates.  It  begins  by  computing 
the  maximum  likelihood  estimate  of  B  for  the  model  without  cons¬ 
training  the  entries  of  Q  to  have  exactly  the  structure  displayed 

* 

in  (2.4).  Instead,  is  replaced  by  H  where 

* 

Q  = 

has  identical  k  x  k  diagonal  blocks,  'P  ,  and  identical  off-diagonal 

*  *  I 

blocks  A  .  In  the  original  notation  Y  =  |  +  A  but  the  constraint 
*  * 

that  ¥  -  A  is  positive  definite  is  not  enforced.  The  advantage  of 

this  modified  model  is  that  the  calculations  are  performed  by  a 
multivariate  regression  program  or  a  simple  covariance  structure’ 
routine  such  as  the  LISREL  routine. 


Once  the  estimates  B  ,  T  and  A  are  obtained  the  eigenvalues  of 

''It  '•it  J  "A 

T  -  A  are  examined.  If  they  are  all  positive  then  |  =  T  -•  A  , 
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B  =  B  and  A  =  A  are  the  maximum  likelihood  estimates  for 
the  panel  model  with  random  individual  effects. 


If  the  eigenvalues  of  'f  -  A  are  not  all  positive  we  apply  the 

following  method,  due  to  Klotz  and  Putter  (1969)  and  used  by  Anderson 
(1984,  1985),  obtain  the  maximum  likelihood  estimates  B,  ^  and  A. 


Let  Z  be  a  nonsingular  matrix  and  D  =  diag  (dj^,...,d^)  a  diagonal 
matrix  satisfying 

i|j*  =  ZDZ'  and  A*  =  ZZ' 


Let  k  be  the  number  of  d^  satisfying  d^>l  and  let  D  be  the  k 

*  * 

diagonal  matrix  of  these  d^.  Let  Z  be  the  matrix  of  k  rows  of  Z, 
the  rows  corresponding  to  those  elements.  The  maximum  likelihood 
estimate  of  ^  is 


1  *  *  *  *  * 

::  =  (z  D  z  '  -  z  z  ') 


and  the  maximum  likelihood  estimator  of  A  Is 


A.  A 

A  =  T  -  f 


The  maximum  likelihood  estimator  of  B  is  obtained  by  constraining 

A  A 

A  =  A  and  ^  |  and  applying  LISREL  or  any  generalized  least  squares 


multivariate  regression  procedure. 
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In  anticipation  of  our  numerical  example  two  other  estimators  of  B 
deserve  mention.  First,  the  model  can  be  transformed  to  differences 
thus  eliminating,  or  masking,  the  individual  effects.  The  "pseudo¬ 
maximum  likelihood"  estimator  of  B  is  the  maximum  likelihood 
estimator  for  the  transformed  model 


z.  -  z,  ^  =  B(w.  -  w.  ,)  +  (e.  -  e.  ,) 

^it  ^i,t-l  ^  ^it  ..i,t-l  ..It  ..i,t-l 


t  =  1 


,T 


This  estimator  is  consistent  in  n  and  is  asymptotically  efficient. 

In  practice  this  method  seems  to  yield  good  approximations  for  the 
regression  coefficients,  poor  approximations  for  the  estimates  of  the  | 
matrix  and  no  approximation  for  the  A  matrix.  We  do  not  suggest  this 
method  be  used.  Similarly  there  are  several  instrumental  variable 
methods  have  been  introduced  for  the  univariate  version  of  this  model 
with  lagged  endogenous  predictors  [Anderson  and  Hsiao  (1981),  Amemiya 
and  MaCurdy  (1986),  Breush,  Mizon,  and  Schmidt  (1986)].  These 
estimators  can  be  extended  to  the  individual  effects  model  but  in  light 
of  the  absence  of  lagged  predictors  and  the  ease  of  the  Anderson 
one-step  estimate  we  do  not  pursue  these  alternatives  further. 


Second  the  individual  random  component  of  the  error  could  be  ignored 
and  estimators  appropriate  for  the  Independent  error  model  be  used. 
These  "multivariate  regression  estimators"  are  obtained  from  the  pooled 
multivariate  regression  of  z^^  on  .  These  estimators  ignore  the 
individual  effect  but  are  consistent  in  the  number  of  observations. 
Moreover,  if  the  correlation  between  the  errors  of  the  dependent 
variables  is  also  ignored  then  "multiple  regression  estimators" 
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of  B  and  |  can  be  obtained  by  isolating  and  regressing  each 
endogenous  variable  on  all  exogenous  variables. 

4.  Application  to  a  Study  of  Perception  of  Care  given  by  HMD's 

To  illustrate  our  methods  of  estimation  we  consider  a  panel  study 
conducted  by  a  consulting  firm  of  the  relationship  between  patient's 
attitudes  toward  Health  Maintenance  Organizations  (HMD)  and  their 
perceptions  of  the  quality  of  care  given  by  such  organizations.  These 
data  are  proprietary  and  have  been  used  to  illustrate  methods  of  testing 
the  strength  effects  in  multivariate  cross-lagged  panel  models  [Mayer 
(1985),  Mayer  and  Carroll  (1986)].  Here  the  analysis  is  used  to 
Illustrate  our  methods  of  estimating  the  effects  of  the  attitudes  on  the 
perceptions  over  waves.  We  formulate  the  appropriate  panel  model  and 
then  estimate  and  Interpret  the  regression  coefficients  and  the  variance 
and  covariance  terms. 

The  data  were  obtained  from  Interviews  of  100  randomly  selected  patients 
upon  entering  and  upon  leaving  a  single  HMD  after  having  requested  and 
seen  a  primary  care  physician  for  the  first  time  since  enrolling  in  the 
HMO.  The  same  100  patients  are  interviewed  again,  before  and  after 
their  next  three  visits  to  the  HMO.  The  100  patients  were  picked  to 
have  enrolled  in  the  HMO  at  about  the  same  time  and  to  have 
approximately  the  same  length  of  time  between  visits  -  about  6  months. 
The  visits  are  for  themselves,  not  for  family  members  (e.g.,  pediatric 
care  or  geriatrics  care),  and  are  for  primary  care,  as  opposed  to 
specialized  care.  None  of  the  patients  are  pregnant,  seriously  ill. 
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chronically  ill,  or  mentally  ill  and  none  have  suffered  serious 
injuries . 

The  four  variables  of  Interest  are  each  a  compilation  of  several 
measurements.  The  raw  data  were  not  provided  by  the  firm  that  collected 
the  data.  We  note  that  the  use  of  a  single  HMO  makes  the  analysis 
highly  tentative  in  that  it  restricts  the  external  validity  of  the 
findings.  However  before  undertaking  a  more  complete  study  the  firm 
wanted  to  know  if  such  effects  existed  in  these  data. 

The  first  predictor  variable,  x^^,  measures  the  degree  to  which  the 
patient  has  a  positive  attitude  toward  the  concept  of  an  HMO  as  a 
provider  of  primary  medical  care;  it  is  measured  at  each  visit  when  the 
patient  arrives  for  his  or  her  appointment.  Issues  of  secondary  care 
are  not  addressed.  The  second  predictor  variable,  measures  the 
degree  to  which  the  patient  has  a  positive  attitude  about  the  specific 
HMO  in  which  he  or  she  in  enrolled;  it  is  measured  at  each  visit  after 
the  patient  has  seen  the  physician,  and  completed  any  treatments. 

The  first  dependent  variable,  z^,  samples  the  patient's  perception  of 
the  quality  of  care  given  by  HMO's  in  general  and  the  second , dependent 
variables,  z^,  samples  the  patient's  perception  of  the  quality  of  care 
given  by  the  particular  HMO  in  which  he  or  she  is  enrolled.  Both  are 
assessed  after  the  patient  has  seen  the  physician  and  completed  any 


treatments. 
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All  of  the  variables  were  scaled  to  have  mean  10  and  standard  deviation 
of  about  1.  This  scaling  protects  the  confidentiality  of  the  data  and 
does  not  affect  our  modeling  since  the  measurements  have  no  natural 
scale . 

The  model  adopted  is  the  Individual  effect  model  displayed  in  (2.1)  and 
(2.2).  The  parameters  are  estimated  in  each  of  four  ways; 

A.  The  maximum  likelihood  method 

B.  The  multivariate  regression  method  (ignores  individual  effect) 

C.  The  multiple  regression  method  (ignores  individual  effect) 

D.  The  one-step  iteration  method  of  Anderson 

E.  The  pseudo-maximum  likelihood  method 

The  correlation  statistics  for  the  raw  data  are  presented  in  Table  1  and 
the  results  of  estimating  the  model  by  maximum  likelihood  are  summarized 
in  Table  2. 

We  begin  interpreting  the  model  estimated  by  maximum  likelihood  by 
noting  that  the  chi-square  goodness  of  fit  measure  for  the  model  is 
461.22  with  90  degrees  of  freedom,  indicating  that  the  model  fits  the 
data  rather  poorly.  In  light  of  this  lack  of  fit  we  treat  all  further 
analysis  as  quite  preliminary  and  somewhat  speculative. 

The  largest  effect  over  time  -  the  coefficient  is  .162  -  is  the  effect 
of  the  patient's  attitude  toward  the  concept  of  an  HMO  as  a  provider  of 
health-care  on  the  perception  of  the  quality  of  care  given  by  the 
specific  HMQ  in  which  he  or  she  is  enrolled.  The  marginal  t  statistic  - 
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computed  from  the  estimate  of  the  standard  error  of  the  coefficient 
obtained  from  the  information  matrix  -  is  4.731  indicating  a  that  the 
coefficient  is  quite  different  from  zero.  As  a  guide  to  interpretation 
we  tend  to  use  the  .05  significance  level  and  two-tailed  rejection 
regions  but  because  of  the  limited  sample  size  we  do  no  formal 
hypothesis  testing.  Patients  that  are  positive  toward  HMO's  as 
health-care  providers  tend  to  perceive  that  their  HMO  gives  high  quality 
care.  On  the  other  hand,  the  same  attitude  does  not  appear  to  have  as 
strong  of  effect  on  the  patient's  perception  of  the  quality  of  care 
given  by  HMO's  in  general  -  the  regression  coefficient  is  -.013  with  a  t 
statistic  of  -.327. 

Similarly,  the  patient's  attitude  toward  the  particular  HMO  in  which  he 
or  she  is  enrolled  appears  to  have  a  very  small  effect,  if  any  effect  at 
all,  on  either  the  perception  of  the  quality  of  care  given  by  HMO's  in 
general  or  on  the  perception  of  the  quality  of  care  given  by  the 
particular  HMO  in  which  the  patient  is  enrolled  -  regression 
coefficients  of  .056  and  .053  with  t  statistics  of  1.38  and  1.54. 

These  results,  if  found  to  be  obtain  across  a  wide  range  of  samples,  may 
be  Important  to  the  HMO  industry  as  they  desire  to  understand  correlates 
of  patient's  perceptions  of  the  quality  of  care  given  by  HMO's  in 
general  and  by  particular  HMO's,  in  order,  in  part,  to  enhance  the 
attractiveness  of  the  HMO  to  workers  asked  to  choose  between  an  HMO  and 
alternative  programs  such  as  third-party  insurance  that  covers  part  of 
the  cost  of  f ee-for-service  medicine.  If  workers  make  their  choice,  in 
part,  based  on  their  perception  of  the  quality  of  care  being  given  by 
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the  particular  HMO  being  offered  and  If  that  perception  can  be  Improved 
by  Improving  the  general  attitude  toward  HMD’s  then  It  may  be  wise  to 
Invest  In  such  Improvement.  On  the  other  hand.  It  may  be  less  wise  to 
Invest  In  Improving  the  attitude  toward  the  particular  HMO  being  offered 
since  that  attitude,  at  least  In  these  data.  Is  not  highly  related  to 
the  perception  of  quality  of  the  care  being  offered. 

Similarly,  our  analysis  suggests  that  Investing  In  Improving  either  of 
the  attitude  measures  may  have  little  or  no  effect  on  the  perception  of 
the  quality  of  care  given  by  HMD’s  In  general.  It  may  not  be  fruitful 
to  attempt  to  Improve  this  perception  by  Investing  In  Improving  the 
attitude  toward  HMD’s  In  general  or  toward  the  specific  HMO.  Although 
more  studies  would  be  needed  before  any  firm  conclusions  could  be 
reached  our  model  does  suggest  hypotheses  worthy  of  further  study. 

Considering  the  maximum  likelihood  estimates  of  the  two  covariance 
matrices,  ^  and  A,  we  note  that  the  entries  in  A  are  considerably  larger 
than  their  estimated  standard  errors  and  in  two  of  the  three  cases  are 
larger  than  the  corresponding  entries  In  their  size  seems  to  indicate 
that  the  individual  effects  may  be  a  larger  source  of  variation  In  the 
data  than  are  the  pure  errors.  We  find  this  pattern  frequently  in 
fitting  this  type  of  model.  If  the  individual  effect  Is  present  in  the 
data  but  ignored  in  the  model  its  variance  tends  to  be  added  to  the 
estimate  of  the  covariance  matrix  of  the  pure  error  and  may  lead  to 
considerable  over-estimation  of  the  pure  error  in  the  model  as  we  will 


se  below. 
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Turning  to  the  comparison  of  the  maximum  likelihood  estimators  with  the 
other  estimators  -  whose  values  are  summarized  in  Table  3  -  we  note 
considerable  similarities  with  a  few  noteworthy  exceptions.  The  first 
estimates  in  Table  3  are  those  obtained  by  ignoring  the  Individual 
effects  and  fitting  the  independent  errors  model  by  multivariate 
regression  methods.  The  regression  coefficients  are  quite  similar  to 
those  obtained  by  maximum  likelihood  except  the  effect  of  x^^  on 
changes  sign,  going  from  -.013  to  .110  with  the  t-statlstic  going  from 
-.327  to  2.11  indicating  a  significant  positive  effect  of  attitude 
toward  HMO's  in  general  on  the  perception  of  the  quality  of  care  given 
by  HMO's  in  general. 

Most  Interestingly,  the  estimate  of  the  covariance  estimate  obtained 
from  fitting  the  Independent  error  model  approximates  the  sum  of  the 
estimates  of  the  two  covariance  matrices,  ^  and  A  in  the  model  which 
allows  an  individual  effect.  For  example,  the  estimate  of  the  pure 
error  of  the  attitude  toward  HMO's  in  general  is  .441  compared  to  .139 
for  the  individual  effect  model. 

The  chi  square  goodness  of  fit  statistic  for  the  independent  error  model 
fit  by  multivariate  regression  methods  is  786  with  93  degrees  of  freedom 
(compared  to  461  with  90  degrees  of  freedom  for  the  model  with 
individual  effects)  indicating  that  removing  the  individual  effect 
reduces  the  goodness  of  fit  sharply.  Even  more  critically,  the  t 
statistics  obtained  from  the  multivariate  regression  calculations  are 
different  than  the  t  statistics  for  the  model  with  individual  effects. 


Most  notabley,  as  indicated  in  Table  3,  the  effect  of  the  attitude 
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toward  HMO's  in  general  appears  to  have  a  fairly  strong  positive  effect 
on  the  perception  of  quality  of  care  given  by  HMO's  in  general.  This 
effect  appears  to  be  Inflated  by  the  exclusion  of  the  individual  effect. 

The  estimators  obtained  for  the  Independent  errors  model  by  applying 
multiple  regression  methods  to  each  equation  separately  are  Identical  to 
those  obtained  from  the  multivariate  regression  methods  except  the 
off-diagonal  entry  in  the  covariance  matrix  of  the  errors  is 
estimated,  aprlorl,  to  be  zero.  The  goodness  of  fit  statistic  for  this 
model  is  818.74  with  94  df,  a  further  large  reduction  in  the  quality  of 
fit. 

The  Anderson  one-step  estimates  are  good  approximations  to  the  maximum 
likelihood  estimates  and  this  closeness  has  held  across  a  number  of 
applications.  In  our  experience  these  estimates  are  preferable  to 
those  obtained  from  applying  Independent  errors  model. 

The  pseudo  maximum  likelihood  estimates  obtained  from  the  equations  for 
differences  are  fairly  similar  to  the  original  maximum  likelihood 
estimates  but  are  quite  inferior  to  the  Anderson  one-step  estimates. 
The  pseudo  maximum  likelihood  method  provides  no  estimate  of  the 
matrix  A. 

As  for  the  issue  of  computation,  the  Anderson  one-step  estimators  are 
very  similar  to  those  obtained  by  maximum  likelihood  and  Involve 
relatively  simple  calculations.  We  suggest  anyone  able  to  do  a 
generalized  least-squares  regression  may  want  to  consider  using  his 
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simple  approximation  rather  than  calculating  the  more  complicated 
maximum  likelihood  estimates.  The  similarity  between  the  estimates 
given  by  his  method  and  the  maximum  likelihood  method  has  obtained  over 
a  variety  of  panel  examples  we  have  considered. 

5.  Discussion 

We  have  considered  the  problem  of  maximum  likelihood  estimation  for  a 
continuous  variable  panel  model  characterized  by  multiple  responses, 
multiple  predictors  and  an  individual  specific  random  component  in  the 
error  structure.  We  show  several  representations  for  these  estimators, 
show  that  the  can  not  be  written,  in  general,  in  closed  form,  and  then 
show  that  they  can  be  written  in  closed  form  for  a  special  case  of  the 
model. 

Our  results  are  intended  to  help  those  empirical  social  scientists 
trying  to  model  panel  studies  but  are  skeptical  of  assuming  the  errors 
for  a  single  Individual  are  independent  over  time.  They  are  also 
intended  to  help  those  empirical  social  scientists  that  would  use  a 
covariance  structure  approach  to  obtain  maximum  likelihood  estimates  of 
the  parameters  but  are  curious  to  know  more  about  the  estimates  they 
have  obtained. 

We  apply  our  results  to  a  set  of  data  on  the  relationship  between  the 
perceptions  and  attitudes  of  patients  enrolled  in  a  health  maintenance 
organization  and  show  that  the  attitude  toward  HMO's  in  general  may  be 
correlated  with  the  perception  of  quality  of  care  given  by  a  specific 
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HMO  but  that  little  correlation  appears  to  exist  between  attitude  toward 
HMO's  in  general  and  perception  of  the  general  quality  of  care  given  by 
HMO's.  We  show  that  the  individual  effect  may  account  for  more  random 
variation  than  does  the  pure  error  and  that  ignoring  this  effect,  by 
fitting  the  independent  errors  model  by  multivariate  or  multiple 
regression,  may  give  somewhat  misleading  results. 

Our  results  need  to  be  extended  in  several  directions.  First  similar 
study  of  maximum  likelihood  estimation  is  needed  for  the  model  with 
lagged  endogenous  predictors.  Second,  for  the  model  with  such  lagged 
predictors  the  problem  of  testing  for  the  presence  of  cross-effects,  a 
central  issue  in  many  applications  of  continuous  variable  panel  methods, 
needs  to  be  addressed.  The  model  with  latent  variables  which  are 
imperfectly  reflected  by  empirical  measures  should  be  explored  and 
finally  the  properties  of  the  alternative  estimators  dealing  with 
samples  of  moderate  size  should  be  considered. 
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Table  1: 

The  raw 

correlations  for  the  HMO  data 

The  simple 

correlations : 

X2 

^2 

.298 

.032 

.030 

"2 

.368 

.189  .093 

The  multiple  correlations: 

[R(z^;  x^, 

X2)]  = 

.001 

[RCz^;  x^. 

Xj)]  - 

.143 
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Table  2.  Maximum  likelihood  estimates  for  the  HMO  data 


A.  Maximum  likelihood  estimators 


-.013  .056 

B:  .162  .053 


.139 

.015 


.015  309 

.110  A:  .076 


B.  Estimated  standard  errors 


.041 
B:  .034 


.041  .052 

.035  ^  4-  A:  .025 


.025  .051 

.022  A:  .024 


C.  Asymtotic  (marginal)  t  statistics 


-.327  1.38 

B:  4.731  1.54 


.076 

.112 


.024 

.021 


Chi-square  goodness  of  fit  statistic  =  461  df  =  90 
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Table  3:  Alternative  estimators  of  the  coefficients  for  the  HMO  data 

A.  Independent  errors  model:  Multivariate  regression  estimators 

.110  .057  .441  .086 

B:  .245  .066  .086  .218  A:  No  estimate 

2.11  1.02 

t  statistics  for  regression  coefficients  =  6.69  1.67 

Chi-square  goodness  of  fit  =  786  df  =  93 

B.  Independent  errors  model:  Multiple  regression  estimators 

A 

Same  as  A.  except  the  estimated  covariance  <^^2  ~  ^ 

Chi-square  goodness  of  fit  =  819  df  =  94 

C.  Anderson  one-step  estimators 

-.009  .056  .151  .020  .292  .065 

B:  .166  .053  t:  .020  .113  A:  .065  .103 

D.  Psuedo  maximum-likelihood  estimators 

-.012  .040  .073  .003 

B:  .058  -.015  .003  .087  A:  No  estimate 
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